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Example: Detect Even Number of 1s 


Start 
Thisisa “transition 


diagram" for a deterministic OB 
finite automaton. 


Diagrams like this 
visualize automata like a 
simple game. 
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Example: Detect Even Number of 1s 


Start 
l 
In this “game”, we will 
move from circle to circle, 
following the instructions ] 


given by an input string. 


Input string: 1111 
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Example: Detect Even Number of 1s 


Start 


The “player” starts at the 
Indicated circle: 


Input string: 1111 
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Example: Detect Even Number of 1s 


The “game” proceeds by 
reading one character at a 
time from the input string 
and tollowing the path 
labeled with the character. 


Input string: {1/111 
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Example: Detect Even Number of 1s 


The “game” ends when all 
input symbols have been 
read. 


Input string: 1111|. 4 


Done! 
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Defining a Deterministic Finite Automaton 


We define a deterministic finite automaton (DFA) as a 
5-tuple: (Q, X, ô, qo, F) 
> Q: A set of states 
> x: A set of input symbols (the alphabet) N 

. .. ó must be defined for all 
p qo: The initial state. qo € Q. symbols in all states. 
> F: A set of accepting (“final”) states. F € Q. x 


> ó: Ihe “transition function" mapping 


ó returns a single state. 
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From the Diagram to (Q, 2, 6, qo, F) 


Start 
The circles represent states. 


> Q = {qo q1} 
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From the Diagram to (Q, 2, 6, qo, F) 


Start 
This automaton only 


handles strings of 1s OMO 
> > = {1} 
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From the Diagram to (Q, 2, 6, qo, F) 


Start 
The initial state is labeled 


with "Start" ONBO 
> qo = qo 


P d 
P di 
"d 
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From the Diagram to (Q, 2, 6, qo, F) 


Accepting states have 
double circles. This 
automaton only has one. 


> F = {qo} 
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From the Diagram to (Q,>, 6, qo, F) 


The arrows connecting the states 
represent possible transitions. 


ó is the automaton’s transition 
function: 


ó (current state, current symbol) 
— destination state 


ó can be represented as a table: 


Current state Destination state 
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Start 


From the Diagram to (Q, 2, 6, qo, F) 


This automaton in tuple 
notation: Start 


c" OLS 


We use a table here, but ó can 
also be described using words, 
mathematical formulas, etc. 
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“Transition Table” Representation 


The table for ó implicitly lists the 


states and alphabet. Start | 

A “transition table” Just adds the 

remaining needed Information: ORMO 
> Indicate the start state with > 1 


> Indicate accepting states with * 


> Example: 


*— Qo qi 


qı qo 
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Notation: Extending ó to Strings 


» Anautomaton's standard transition function, ó, takes two 
parameters: a state and a symbol. 


> The "extended transition function", 5, takes a state and a string. 
> ô can be defined in terms of ó: 
* Assume that w is a string, a is a symbol in >, and q is a state. 
* Recursively, ó(q,wa) = ó (ê (q,w), a). 
> Examples from the previous automaton: 
+ Ó (qo, €) = qo 
+ (qo, 111) = qı 
* ó(qo, 1111) = qo 


6(q,a) = (q, a) for DFAs. 
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Example: Proofs About Automata 


Here is a more complex 
automaton. 


Transition table 
representation: 


qi qo q2 
* d2 | Yo q2 
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Example: Proofs About Automata 


Questions: 


» What language does 
this automaton 
represent? 


» How should we prove 
it's correct? 
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Example: Proofs About Automata 


L = {x |x has an odd 
number of 0s and ends 
with a 1]. 


We will prove this by 
induction on the length 
of an input string, x. 


Start 
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We start our proof by 
defining what each state 
means about the input 
read so far: 


> qo: Even # of Os 


> qı: Odd £ of Os, and 
ends with a 0 


> go: Odd # of Os, and 
ends witha 1 
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Example: Proofs About Automata 


Base case: Prove the 
definition is correct for a 
string of length 0 (e). 
The automaton is in 
state qo after processing 
e. 


Since £ contains an even 
number of Os, our 
definition of qo holds. 
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Example: Proofs About Automata 


Inductive step: Assume 
that ó(qo, x) is correct 
for string x. 


We need to prove that 

Ó (qo, xa) remains correct 
for any symbol a. 

This requires proving 
correctness for all 
possible transitions from 
all three states (mutual 
induction). 
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Example: Proofs About Automata 


Induction part 1: state qo 


If (do, x) = qo, then we 
can assume x contained an 
even number of Os. 


ó(qo, 1) = qo. Reading a 1 
doesn't change the # of Os, 
so this is correct. 


ó(qg, 0) = q1. We've read 


an odd £ of zeros, but the 
string doesn't end in 1 yet. Í 
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Example: Proofs About Automata 


Induction part 2: state q1 


If ó(qo, x) = q,, then we 
can assume x contained an 
odd number of 0s and 
ends with a 0. 


6(q1,1) = q2. The string 
contains an odd t of Os, 
but now ends with 1. 


6(q1,0) = qo. Reading an 
additional 0 means that 
the string contains an even 
number of Os. 
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Example: Proofs About Automata 


Induction part 3: state q; 


If ó(qo, x) = qz, then we 
can assume x contained an 
odd number of 0s and 
ends with a 1. 


ó(q5,1) = q2. This doesn't 
change the # of 0s or the 
fact that the string ends 
with a 1. 


6(q2,0) = qo. Reading an 
additional 0 means that 
the string contains an even 
number of Os. 


Start 
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Example: Proofs About Automata 


Finishing up: 

We've now proven that 
our claims about the 
states were correct, but 
we still need to prove 
the automaton 


recognizes thelanguage. Start 


The automaton ends in q; if and only if the string contained an 
odd number of 0s and ended with 1. 


Since q> is the only accepting state, the automaton ee DE. 
if and only if they contain an odd number of Os and end with a 1. 
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Nondeterministic Finite Automata 


» We've been looking at deterministic finite 
automata (DFAs) so far. 


* ô returns exactly one state for every symbol in 
every state 


» With nondeterministic finite automata (NFAs), the 
transition function ó returns a set of states. 
*0:QX£ZX2o 29: The power set of Q. 


I : (the set of all possible 
* This can include no states at all! subsets of Q) 


A 
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Note on "Nondeterministic Terminology 


» DFAs always follow the same path for a single input 
string. 

* DFAs accept a string if and only if this path leads to 

an accepting state. 


» NFAs may follow one of many different paths for the 
same input string. 


* This is why they are called nondeterministic. 


+ NFAs accept strings if and only if it is possible for 
them to reach an accepting state for a given input 
string. 
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Extended Transition Function for NFAs 


> As with DFAs, ó for NFAs processes a string rather 
than a single character. 


> As with the definition of 6 for NFAs, 6 for NFAs 
returns the set of states an NFA is in after 
processing a string. 


» If an NFA has a start state q, then the NFA accepts 
string x if and only if (q, x) n F + Ø 


+ if 


* The set of states after processing x contains at 
least one accepting state" 
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Recursive Definition of ó for NFAs 


" As with DFAs, 
» ó (q, £) =q (q,a) = ó(q,a) for NFAs. 


> ó(q,wa) ={ p | for some state r in ó(q,w), pisinó(r,a 


States in 
ó(q, wa). 


a set. 
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Definition of ó for Sets of States 


> Since ó can return a set of states for NFAs, it can be 
helpful to define a version of ó that takes a set of 
states rather than a single state. 


If P is a set of states, 
ó (P, a) m UgepÓ(q, a) 
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Nondeterministic Finite Automata 


Example: Match all strings 
ending with 01 
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Example NFA Execution 


Start 
Input string: [10101 
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Example NFA Execution 


0.1 


8.2.9 


Start 


Input string: 10101L 


Done! 
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Example NFA Execution 


0,1 
> F = {q2} 
> ó (qo, 10101) = (qo, q2} 


L 
> {qo q2} NF = {q2} o : o l © 


As expected, this NFA Start 
accepts 10101, because it ends Input string: 10101 
in a set of states containing an 
accepting state. 
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NFAs vs DFAs 


» NFAs are often more convenient than DFAs 


* Write an NFA that accepts L = {x | x is a string of 
Os or 1s that contains 0101000 as a substring} 


+ Now write a DFA that accepts L 


> Good news: Any language that can be recognized 
by an NFA can also be recognized by a DFA. 
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Equivalence of NFAs and DFAs 


> Let N = (Q, È, ô, qo, F) be an NFA. 


» We will show how to construct an equivalent DFA, 
D, using a technique called subset construction. 


» Main idea: D will keep track of the subset of states 
that N might be in. 


* In other words, each of D's states corresponds to 
a subset of N's states. 
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Subset Construction 


> The constructed DFA D = (Q'; X, ô’, qo, F'), where: 
* Q' = 2? = Assuming the states in Q are 
(do. 91) ++» In}, the states in Q are all possible 
subsets of {qo, q4, ..., qn}. 
*qo = (qo) 
eF'-lqeQ|q- for ..] and q; € Fj 


Q^ D's final states consist of all subsets containing one 
or more of N’s final states." 


* For all q and p in Q’, ó'(q,a) = p iff (q,a) = p. 
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Subset Construction: Example 
» Start with the following NFA: 
* N = (lqo 91 q2}, (0, 15, 0, qo, (427) 


> Construct DFA D = (Q’, 10,1), ó', {qo}, F"), where 
+ Q' = 
(9, {qo} {qi} {42} {40 41} {40> 423, 14 42); {do qa, q2)) 
+ F' = {{q2} (do, q2} (05 325 {qo qi, q2}} 
*Ó is defined on the following slide. 
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Subset Construction: Example 


>ô = 
Ø Ø Ø 
{qo} | {q1} | (qo) 
{q1} | (qo) | (qi, q2} 
fa} | o | o 
(qo, d1J | (qo, 913 | (qo, q1» q2) 
(do. q2} | {q1} | (qo) 


{91923 (qo) | (qi, q2} 
(qo, q1» d2) | (do, q1} | (qo, d q2) 


Jim Anderson (modified by Nathan Otterness) 


Subset Construction: Example 


Diagram for D: 


Ø Ø Ø 
> {qo} | {41} | (qo) 
P m 
«(3 | o | 2 
(qo, 41) | (do, 41) | (qo, 41, 423 
*(4,43 | {a3 | (aj 
*(q,43 | («3 | (aa2 


* (49,41, 42) (do, 41) | (25,4142) 
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Subset Construction: Example 


Diagram for D: 


We don't care 
about these states; 
they are unreachable 
from the start state. 
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Subset Construction: Example 


Diagram for D without 
unreachable states: 
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Theorem 2.11 


Theorem 2.11 (from the textbook): 
If N is the original NFA and D is the constructed DFA 


(as defined earlier), then L(N) — L(D). 


Proof: We need to show that ó'(qu, x) = S if and only 
if ó(qo, x) = S. 


We will prove this by induction on |x|. 
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À 


Reminder: 
Proof of Theorem 2.11 P i AE 


ó is for the NFA N 


Base case: 
|x| = 0. (Put another way, x = 8). 
Verifying the base case: 

Ó (qo, €) = qo = (qo) 

and 
(qo €) = (qo) 

by the detinition of the extended transition function. 
So, L(N) = L(D) holds for the base case. 
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Reminder: 
Proof of Theorem 2.11 r AE 


ó is for the NFA N 
Inductive step: 
Reminder: 
By the inductive hypothesis we assume that: For string w and symbol a: 


) 3 á(q, wa) = 5(6(q,w), 
5'(qh,x) = S iff (qo, x) = S UE ot q,w), a) 


ó'(Sja) = T iff 6(S,a) = T, by the definition of ô”. 
Therefore ô' (q4, x) = T iff (qo, x) = T. 
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À 
Finishing the Proof of Theorem 2.11 E 


ó' is for the DFA D 


ô is for the NFA N 


Finally, since ó' (qo, x) is in F' if and only if À (qo, x) 
contains a state in F, L(D) = L(N ). 


» Note: This construction results in a state explosion. 
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NFAs with -Transitions 


NFAs with -transitions have all the same rules as 
regular NFAs, but with additional flexibility. 


The transition function for NFAs with e-transitions: 
6: Q x (LU {e}) 5 29 


Example: 


Start 
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e-Closure 


Let ECLOSE(q) = 
{q} U {p | p is reachable from q via £ — transitions} 


> ECLOSE (qo) - (qo; qi, q2) 
> ECLOSE (q1) = 141,02) 


Start 


For a set of states P, 
ECLOSE(P) = Ugep ECLOSE(q) 
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Definition of ó for e-NFAs 


Recursive definition of 6: 

> (q, £) = ECLOSE(q) 

> For a string w and symbol a: ó(q,wa) = ECLOSE (P), 
where P = {p | for some r in ó(q,w), pis in ó (r, a)} 


> In other words, ó(q,a) = ECLOSE(6(ECLOSE (q), a)) 
for a starting state q and a single symbol a. 


Unlike before, (q, a) + 5(q, a) for e-NFAs! 
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e-NFA Example 
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Input string: 011 


ó((qo), €) = (qo, q1: q2} 


How to simulate an £-NFEA: 

1. Follow transitions as you 
would for a normal NFA. 

2. Take the e-closure for 
any states you end up in. 


e-NFA Example 


How to simulate an £-NFA: 

1. Follow transitions as you 
would for a normal NFA. 

2. Take the e-closure for 
any states you end up in. 


Start 


Input string: 


ó((qo), 0) = (qo, q1: 923 
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e-NFA Example 
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Current Symbol 


Input string: (1 


8 ({qo}, 01) = {41,92} 


j transitions as you 
would for a normal NFA. 
Take the £-closure for 

any states you end up in. 


e-NFA Example 
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Current Symbol 


Input string: O1[I 
ó((q0), 011) = {41,423 


How to simulate an £-NFEA: 

1. Follow transitions as you 
would for a normal NFA. 

2. Take the -closure for 
any states you end up in. 


e-NFA Example 
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Current Symbol 


Input string: 011| | Done! 
ó((q9), 011) = {41,42} 


How to simulate an £-NFA: 


1. Follow transitions as you 
would for a normal NFA. 

2. Take the e-closure for 
any states you end up in. 


Extending ó to Sets of States 


This is similar to normal NFAs. If R is a set of states: 


6(R,a) = UqeR ó(q,a) 
&(R, w) =Uger Š(q, w) 


LN 
P di 
"d 
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The Language of an e-NFA 


NFAs with e-transitions define languages similarly to 
standard NFAs: 
If M is an NFA with e-transitions, then: 

L(M) = fw | À (qo, w) contains a state in F } 


More good news: any language that can be recognized 
by an e-NFA can also be recognized by an NFA 
without e-transitions. 
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Eliminating ¢-Transitions 


» The textbook shows how to transform an NFA with 
€-transitions to a DFA. 


> We will instead show how to transform an NFA 
with e transitions into an NFA without €-transitions. 


4 You could then transform such an NFA into a 
DFA using subset construction. 
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Eliminating ¢-Transitions 


> Let E be an NFA with €-transitions: (Q, È, 6, qo, F) 


> Define N to be an NFA without e-transitions. 
N = (Q, £, 6", qo, F'), where: 


+ 6'(q,a) = (q,a) 


erc F U {qo} , if ECLOSE (qo) contained a state in F 
F , otherwise 
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da | 0 | iq q2} | {923 
A Ø | Ø | (q2) 


Jim Anderson (modified by Nathan Otterness) 


» If: Proving this is easy (see Theorem 2.22 in the book) 


» Only if: The textbook directly constructs a DFA D 
from £-NFA E, but we will instead construct an 
ordinary NFA N, and use Theorem 2.11 to conclude 
that Theorem 2.22 holds. We start by defining N as it 
was on the preceding slides. 
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Rather than starting with a claim 
about L(E) or L(N), we instead 
claim that ó'(qo, x) = (qo, x) for 
some string x. 


We will prove this claim using induction on |x]. 


> Note: This may not hold for |x| = 0. For example, 
in the previous example ó(qo, €) = (q9, 44, q2}, but 
Ó' (qo, £) = {qo}. 
We instead use |x| = 1 as our base case (next slide). 
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Jim 


A Reminder: 
Proof of Theorem 2.22: Base Case ae a 


ô is for the £- NFA E 
N = (Q,X,6', qo, F), where: 
° 6'(g,a) = Ó6(ECLOSE(q),a) 


A ine F U {qo}, if ECLOSE(qo) contained a state in F 
— (F , otherwise 


Base case: |x| = 1 


For any symbol a, ô' (qo, a) = (qo, a), by the |... Claim: 
definition of ó'. Ó' (qo, x) = ó(qo, x) 
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Let x = wa, where w is a string 

and a is a symbol. 

We must show that Ó'(qo, x) = 

ó (qo; x). 

By the inductive hypothesis, ó'(qo, wW) = ó (qo, w). 


ó' (qo, wa) 

= ó '(ó '(qo, w), a) , by the inductive definition of ô' 

= Uqcë'(qo,w) Š '(q, a) , by the definition of 6" for sets of states 

= Uqeë(qo,w) 5(q, a) , by the inductive hypothesis and definition of ô’ 

= 6(6(qo, w), a) , by the definition of 6 for e-NFAs and sets of states 


= ó (qo, wa) , by the definition of ô 


Proof of Theorem 2.22: Finishing Up Reminder: 


ó. is for the NFA N 
ô is for the £-NFA E 


To show that L(N) = L(E) we must show that ó'(qo, x) 
contains a state in F iff (qo, x) contains a state in F. 


Additionally, we need to deal with |x| = 0. 
Case where x = &: 

> ó' (qo, £) = (qo) 

> (do, €) = ECLOSE (qo) 


> qo isin F' if and only if ECLOSE(qo) contains a state 
in F, by the definition of F”. 
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Proof of Theorem 2.22: Finishing Up Reminder: 


ó. is for the NFA N 


ô is for the £-NFA E 


Case where x +£ €: 
> By the inductive proof earlier, Ó'(qo, x) = ó(qo, x). 
> If F’ = F or qo € ó' (qo, x), we are done. 
> Otherwise, qo € F', qo € F, and qo € ó (qo, x). 

* In this case, some state in ECLOSE (qq) is in F. 


* By construction of ó, that state is in (qo, x). 
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